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Abstract 

Suppose that A and B are real stable matrices, and that then dif- 
ference A — B is rank one. Then A and B have a common quadratic 
Lyapunov function if and only if the product AB has no real negative 
eigenvalue. This result is due to Shorten and Narendra, who showed that 
it follows as a consequence of the Kalman-Yacubovich-Popov solution of 
the Lur'e problem. Here we present a new and independent proof based 
on results from convex analysis and the theory of moments. 



Key words: quadratic Lyapunov function; Hankel matrix; discrete moment 
problem. 

AMS Subject Classification: 15A48, 34D20, 34H05 



1 



1 Introduction and statement of results 



This paper presents a new proof of the Shorten-Narendra Theorem |H], which 
gives a simple spectral condition for the existence of a common quadratic Lya- 
punov function (CQLF) for two stable matrices whose difference is rank one. 
Recall that a matrix A is stable if the spectrum of A lies wholly in the open left 
half of the complex plane. An equivalent condition is the existence of a positive 
definite matrix P such that PA + A^P is negative definite, in which case the 
function x"'"Px is a quadratic Lyapunov function for the system x = Ax. Con- 
sideration of the switching system x = y4(t)x with A{t) G {A, B} leads to the 
notion of a common quadratic Lyapunov function (CQLF), which is determined 
by a positive definite matrix P satisfying 



The following theorem of Shorten and Narendra provides a simple test for 
the existence of a CQLF in the case where A — B is rank one. The theorem 
is stated in [Hj for matrices in companion form, however this is unnecessary jH] 
and we state the result in its full generality here. 

Theorem 1 [Shorten and Narendra] Let A and B be stable matrices and sup- 
pose that A — B is rank 1. Then the necessary and sufficient condition that 
{A, B) have a CQLF is that the matrix AB does not have a real negative eigen- 
value. 

The proof of Theorem ^ presented in [Sj first relates the spectral condition 
on AB to the following positivity condition for the resolvent of A along the 
imaginary axis: 



where A — B = uv^. The authors then make use of earlier work of Narendra and 
Goldwyn [7^ and Willems jUj which showed that this resolvent condition (known 
as the circle criterion) is equivalent to the existence of a CQLF. These earlier 
papers proved the equivalence by transforming the question of the existence of a 
CQLF for the pair [A, B) into the existence of a solution for the Lur'e problem. 
They then used the fundamental results of Kalman |3] who used techniques from 
analytic function theory to show that the circle criterion gives a necessary and 
sufficient condition for the existence of a solution of the Lur'e problem. 



PA + A^P < 0, PB + B^P < 



(1) 



Rez = ^ 1 + Re v^{z - A^^u > 



(2) 
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The result of Theoremnis strikingly simple, and it gives an easy way to check 
for the existence of a CQLF. It also encourages the belief that there should be 
a direct and independent proof which does not use the equivalence between the 
CQLF problem and the Lur'e problem. In this paper we provide such a proof, 
using methods of convex analysis and the theory of moments. The proof has a 
geometrical flavor which is described in the next paragraph. 

There is a dual formulation of the CQLF condition in terms of intersecting 
cones in the space of symmetric matrices. Given a real matrix A, define 



That is, C{A) is the cone of symmetric matrices of the form AX + XA'^ where X 
runs over all positive semidefinite matrices. Considering real n x n matrices as 
n^-component vectors with the Hilbert-Schmidt inner product, the existence of 
a quadratic Lyapunov function for A is equivalent to the existence of a positive 
definite matrix P such that {P, M) = TrPM < for all M 7^ in C{A). It 
is convenient to view this in terms of the hyperplane which is the orthogonal 
complement of P, in which case the condition is that the cone C{A) lies on 
one side of the hyperplane. Correspondingly, the existence of a CQLF for A 
and B is equivalent to finding such a hyperplane with both cones C{A) and 
C{B) on the same side, or alternatively with the cones C{A) and C{—B) on 
opposite sides. Therefore the existence of a CQLF for A and B is equivalent to 
the non- intersection (except at the origin) of the cones C{A) and C{—B). This 
observation leads to the following proposition. 

Proposition 2 Let A and B be stable matrices. Then the pair {A, B) does NOT 
have a CQLF if and only if there are nonzero positive semidefinite matrices X 
and Y such that 



The main result of this paper is contained in the following theorem. It 
describes a special property of the intersection of the cones C{A) and C{—B) in 
the case of interest here, namely when A—B is rank 1. The extreme points of the 
cone C{A) have the form Aw'^ + \y'^A'^ , where v is a vector. The next theorem 
shows that whenever the cones C{A) and C{—B) have a nonzero intersection, 
then the extreme points of the cones must also have a nonzero intersection. 



C{A) = {AX + XA^ \X>0} 



(3) 



AX + XA^ + BY + YB"^ = 



(4) 
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Theorem 3 Let A and B he stable matrices, with A — B rank one. Suppose 
that there are nonzero positive semidefinite matrices X and Y such that 

AX + XA^ + BY + YB^ = (5) 

Then there are nonzero vectors v and w such that 

A^r^r^ + vv^A^ + Eww^ + ww^5^ = (6) 

Combining Proposition |21 and Theorem |21 shows that the pair [A, B) does not 
have a CQLF if and only if there are nonzero vectors v and w such that © holds. 
The proof of Theorem^ is completed by showing that for stable matrices A and 
B, the existence of vectors v and w satisfying (jH)) is equivalent to the condition 
that AB has a real negative eigenvalue. This equivalence was first shown in a 
more general setting by Mason and Shorten The idea is simple: there are 
only two possible ways for the equation © to hold - either v = aBw for some 
a, or else v = aw for some a. The first possibility leads to {aAB + a~^)w = 0, 
which is precisely the condition that AB has eigenvalue — a"^. Running the 
argument in reverse shows that the conditions are equivalent. 

The second possibility would imply that {a'^A + B)w = 0, or equivalently 
that some convex combination (1 — x)A + xB is singular. However writing 
A — B = R we have 

det[{l- x)A + xB] = det[A] det[I - xA~^R] 

= det[A] (l-xTr{A-^R)^ (7) 

The left side of ((Tj) is nonzero and has the same sign at x = and x = 1, hence 
the right side cannot vanish for any value of x between and 1. This rules out 
the second possibility. 

Thus we see that Theorem ^ follows directly from Theorem |21 and the rest 
of the paper is devoted to its proof. In section 2 we show that it is sufficient 
to assume a special form for the matrices known as companion form. The main 
work of the paper appears in section 3 where we prove Theorem El The proof 
uses some relations between Hankel matrices and the solution of the discrete 
moment problem, and some linear algebra arguments. These are derived in 
Appendices A and B. 
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2 Reduction to companion form 



Let us write 



A-B 



where x and y are vectors in R". Let V be the span of x, Ax, A^x, .... Suppose 
first that is a proper subspace of R". Then R" = V Q) V-^ and with respect 
to this decomposition A and B are block matrices of the form 



A 



Ai A2 
A. 



B 



Bi B2 
A-s 



(9) 



Since the spectrum of A is the union of the spectra of Ai and A3, it follows that 
Ai, A3 and Bi are also stable. Now suppose that (jSj) holds, and write X and Y 
in block form 



X 



Xi X2 
X2 X3 



Y 



Yi Y2 
Y^ Y3 



Then it follows from (jSJ that 

A3{X3 + Y3) + {X3 + Y3)A, 







(10) 



:iii 



which in turn implies that X3 + Y3 = since ^3 is stable. Then the positivity 
of X and Y imply that X2 = X3 = F2 = ^3 = 0. Therefore (0) reduces to 



AiXi + XiAj + BiYi + YiBj = 



(12) 

_ ^ , _ ^, Since 

xy""" where y is the projection of y onto V, the equation (fT^ is a 



This means that it is sufficient to prove Theorem El for the pair {Ai, Bi 
Ai-B, 

special case of (0), namely the case where the vectors x, Ax, A^x, . . . span the 
whole space. Hence without loss of generality we will assume that the vectors 
^x are linearly independent. In this case the pair (A, x) is 
called completely controllable. We next show how this allows a change of basis 
into a special form known as companion form (see |4j for details). 
We first introduce the matrix 



S 



/O 1 








1 










1 

0/ 



(13) 
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and the vector 

VV 

Then a matrix A is said to be in companion form if it can be written 

A = S + gh^ (15) 

for some vector h. Suppose that the pair {A, x) is completely controllable, and 
that the characteristic polynomial for A is 

A"" + a.r.A"-^ + . . . + aiJ = (16) 

Then we choose the following vectors as a basis: 

X 

e„_i = {A + anl):>i- 

e„_2 = {A^ + ttnA + a„_i/)x 

ei = (A"-i + a^A'^-^ + . . . + a2/)x 

The condition that (A, x) is completely controllable guarantees that these vec- 
tors form a basis. Furthermore when the matrix A is written in this basis, 
it is easily seen to have the form (jl5j) . That is, there is a non-singular real 
matrix R such that i?x = g and RAR~^ has the form (jl5|) . It follows that 
RBR~^ = RAR^^ — gy^R^^ is also in companion form, and furthermore that 
the pair {A, B) has a CQLF if and only if the pair {RAR'^, RBR'^) has a CQLF. 
Similarly for the condition that AB has a negative real eigenvalue. Therefore it 
is sufficient to prove Theorem Qfor the case that both A and B are in companion 
form. 

3 Proof of Theorem [3] 

3.1 Solving AX + XA^ + BY + YB^ = 

We assume henceforth that A and B are both in companion form, that is 

A = S + gh^, B = S + gk^ (17) 
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and that equation (0) holds. Define 

Z = X + Y (18) 

and 

w = (k-h,r(k-h))"^/^ r(k-h) (19) 

Note that (k — h, Y{k. — h)) cannot be zero, as this would imply that AZ + 
ZA^ = which is impossible since Z 0. Then we can rewrite (0) as 

SZ + ZS^ + gh^Z + Zhg^ + (k - h, w) (^gw^ + wg^) = (20) 

It will be convenient to separate into a pair of equations. Let 11 denote 
the orthogonal projection onto the subspace orthogonal to the vector g, so that 

n = J - ggT (21) 

Then the equation ()2Up is equivalent to the following two equations: 

n^zn + uzs^u = o (22) 

and 

SZg + Zh + (w, k - h)w = (23) 

Furthermore, an application of the Cauchy-Schwarz inequality shows that Y > 
ww"'", and hence 

Z > ww^ (24) 

This means that the pair of matrices X' = Z — ww""" and Y' = ww""" also satisfy 
(0). Therefore the existence of any pair {X,Y) which satisfy (0) implies the 
existence of a pair Z — ww"^ and ww""" satisfying (0), where Z and w are related 
by (j22I) and (jini)- Conversely, if Z and w satisfy (j22I), (|2S1) and (j211), then they 
provide a solution of (0). Therefore we have the following result which describes 
the solutions of (0). 

Lemma 4 Suppose that Z > and w satisfy ^EB)> ^'^^ Then the 

pair X' = Z — ww"^ and Y' = ww^ satisfy Conversely, suppose {X, Y) 
satisfy (0). Let Z = X + Y and define w by M9^] . Then Z and w satisfy \2^) . 
(dg), and g. 
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We now return to the equation (|23|) and solve for w. Define 



e = SZg + Zh (25) 

If Z and w satisfy the equations (|22p and (|23|). then it must be true that 

(h-k,O>0 (26) 

This is a condition on the matrix Z. If it is satisfied, then fl23|l can be solved 
for w: 

w=(h-k,0-'/'e (27) 
The condition Z > ww^ is equivalent to 1 > w^Z^^w. Defining 

we can combine the two conditions ()2fij) and ()24j) as 

< F(Z) < 1 (29) 
We can now restate Lemma ^ as follows. 



Lemma 5 Suppose that Z > satisfies l\2^} and \29\) . Define w hy \21\j . Then 
the pair X' = Z — ww"^ and Y' = ww"^ satisfy (Ej). Conversely, suppose {X, Y) 
satisfy (0), and let Z = X + Y . Then Z satisfies and 1^) . 

Lemma El shows a many-to-one correspondence between the solutions of ^ 
and the matrices Z satisfying (j^^ and ()29p. Therefore we have reduced the 
proof of Theorem 121 to the following problem: suppose that there is some matrix 
satisfying (j22j) and (|29|). Then we want to show that there is another such Z 
satisfying (j22j) and (|29|) for which both X' = Z — ww'^ and Y' = ww^ are rank 
1. Equivalently, we want to show that there is a rank 2 matrix Z satisfying ()22p 
for which F{Z) = 1. 
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3.2 Representation using Hankel matrices, and the mo- 
ment problem 

We use the easily verified fact tliat every symmetric matrix Z wliicli satisfies 
(j22p has the following form: 













Z2 










-Z2 





-z\ 















-Z1 





^3 






v 



\ 



(30) 



Except for the minus signs, ()30|) is an example of a Hankel matrix. Positivity of 
Z requires that > for alH = 0, . . . , ra — 1, and also imposes other constraints. 
To describe the possible values of {zi}, we introduce for each real x the following 
rank 2 matrix of the form (jSO)): 



Zix) 



( 


1 





—X 





x^ 







X 





—x^ 







— X 





x^ 





—x^ 







—x^ 





x^ 





\ 













(31) 



The next result shows that every matrix Z > satisfying ()22|) and ()23p 
can be written as a positive linear combination of the matrices (13111 for some 
non-negative values of x. 



Theorem 6 Suppose that the n x n matrix Z > satisfies equations \2^) . 
\2'J^] and \24^ . Then there is an integer p < {n + l)/2, non-negative numbers 
< xo < xi < . . . < Xp-i, and positive numbers /xq, • • • , /^p-i, such that 

p-i 

Z = J2f^iZixi) (32) 

Ifp = {n + l)/2 then xq = 0. 



The proof of Theorem IHl is presented in Appendix A, using standard results 
form the theory of moments. Indeed, the result is equivalent to the solution of 
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the discrete moment problem for zq, . . . , Zn-i, which is the problem of finding 
distinct non-negative numbers xq, . . . , and positive /zq, • • • , /^p-i, so that 



p-i 

Zj = fiixi, < j < n — 1 (33) 

1=0 

If there is a solution of ()33|) . then the special form of the Hankel matrices implies 
immediately that (j32p holds, and vice versa. 

The decomposition (|32p is the key for solving the problem posed after Lemma 
El we will show that if Z satisfies the equations (j22I), (ESI) and (j21I) so that the 
representation (jH^ holds, then at least one of the matrices {Z{xi)} must also 
satisfy these equations, and hence by Lemma El it provides a solution of ©• 
Since Z{xi) has rank 2, this almost completes the proof of Theorem El The 
only remaining obstacle is that the matrix X' = Z{xi) — ww"^ may have rank 
2, or equivalently F{Z{xi)) < 1. To complete the proof we will show that in 
this case there must be another number y < Xi for which F{Z{y)) = 1. Then 
Z{y) — ww^ will have rank 1, and hence can be written as vv^, so that © 
holds. 

3.3 Completion of the proof 

The key to the solution is the following Lemma, which displays a remarkable 
property of the function F{Z) when Z has the form (jH^ . 

Lemma 7 Suppose that Z satisfies the hypotheses of Theorem O so that the 
representation / IJijj) holds. For each i = 0, . . . ,p — 1 define 

^, = SZ{x,)g + Z{x,)h (34) 

Then 

F{Z) =f(j2 f^^ZixA = ^^J' (35) 

Lemma [7\ in proved in Appendix B. We now use it to complete the proof 
of Theorem El By assumption there is a matrix Z satisfying the hypotheses of 
Theorem El and so Lemma dean be used to evaluate F{Z). We now consider 
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how the right side of (|35|) varies as the parameters /ij change. Our goal is to 
show that there is some i such that F{Z) > F 

Notice first that if (h — k, ^j) < for any i, then we do not increase F{Z) 
by setting /Xj = 0, so we will assume that (h — k, ^j) > for all i. It is straight- 
forward to compute the derivative with respect to the parameter /ij. Since the 
sign of this derivative is independent of the value of fii, it follows that F{Z) is 
a monotone function of each /ij. Consider first how F{Z) behaves as fiQ varies. 
F{Z) must decrease either as /io — > oo or as /io — > 0. In the former case we get 

F{Z)>F{Z{xo)) (36) 

while in the latter case 

F{Z)>F^^fi,Z{x,)^ (37) 

By repeating the same argument if necessary with /ii,/i2, ... we eventually de- 
duce that 



l>F{Z)>F{Z{xi))>0 (38) 

for some i. Recall from Lemma^lthat any matrix Z satisfying ()22|) and F (Z) < 
1 provides a solution of (0), namely X' = Z — ww"^ and Y' = ww^. Hence ()38p 
implies that Z{xi) provides such a solution. 

Since Z{xi) has rank 2, it follows that X' has rank 1 or 2. If X' has rank 1, 
then we can immediately deduce that (jHI) holds, and the proof is complete. The 
condition that X' has rank 1 is F {Z{xi)) = 1, so we are left with the case where 
F{Z{xi)) < 1. We now show that in this case there is another value y < Xi 
such that 

F{Z{y)) = 1 (39) 
This fact follows from these observations: 

(a) F{Z{x)) is a rational function of x; 

(b) F{Z{x)) ^ for all x > 0; 

(c) either F(Z(0)) > 1 or F(Z(0)) < 0. 
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To see that (b) is true, note that F{Z{x)) = would imply SZ{x)g+Z{x)h = 0. 
However this would imply that AZ + ZA^ = 0, which is impossible because A 
is stable. Similarly (c) is the statement that Z{0) cannot arise as a solution 
of (0). Continuity now implies that there must be some y < Xi such that (jH^ 
holds, and this completes the derivation of (P). 
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A Proof of Theorem [HI 

There are many results known for the discrete moment problem. We have found 
special cases of our result in the literature (for example when n is even and Z 
is nonsingular j^) but not the full statement. For this reason we include the 
proof here; our starting point is the following result from the text of Ahiezer 
and Krein pp. 

Lemma 8 Given a sequence sq, si, . . . , S2m-2 le^t K denote the m x m Hankel 
matrix with entries 

Kij = Si+j-2, i,j = l,...,m (40) 

If K > 0, then there is an integer p < m — 1, numbers xi, . . . ,Xp, and positive 
numbers /ii, . . . , /ip and M such that 

p 

Sk = J^/iiX," (A; = 0,...,2m-3) (41) 
1=1 
p 

S2m-2 = ^/iiX^-2 + M (42) 
1=1 

We now use Lemma|Hlto prove TheoremlHl First suppose that n = 2m — 1 is 
odd, and that Z has the form (jHUjl . Then letting Sk = Zk for k = 0, . . . , 2m — 2 
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it follows that the matrix K defined by (|4Uj) is positive semidefinite (the minus 
signs of some off-diagonal entries in Z can be removed by conjugation with a 
diagonal matrix with ±1 on the diagonal). Hence the representation (PT|) implies 
that there is some p < m — 1 such that 



Zk 



Z2m-2 



E 

1=1 
p 

E 

i=l 



2m-2 



(A; = 0, . . . , 2m - 3) 



+ M 



and therefore we get the following representation for Z: 



(43) 
(44) 



4 = 1 



The rank 2 matrix Z{x) was defined in (j31|) . It can be written as 

Z{x) = u(x)u(x)'^ + xv(x)v(x)'^ 
where u{x) and v(x) are the n-vectors 



u(x) 



/ 1 \ 



—X 



[-x)2 




\ 



/ \ 

1 




v(x) = S''^u(x) 



-X 





-x) 




V 



(45) 



(46) 



(47) 



Since distinct, and 2p < 2m — 2 < n, it follows that the 2p + 1 

vectors {u{xi),\{xi)} and g are linearly independent (this is easily demonstrated 
using the Hadamard determinant). Hence positivity of Z implies that each term 
in ()45|) is separately positive. From ()46|) it then follows that 



Xi > 0, 



(4^ 



It remains to show that M = in (jl^jl . This requires using ()23|) and (j21I). 
Suppose first that Z is singular; then counting dimensions in (j45p shows that 
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either M = or else p < m — 2. In the latter case it follows that the vectors 
{u(xj), v(xj)}, g, Sg are linearly independent. Furthermore for any x, 

SZ{x)g = (49) 

Therefore from (|23p it follows that w is a linear combination of the vectors 
{u{xi),v{xi)}, g, Sg. If M > then the coefficient of Sg in this combination 
is nonzero. But (^3)) then implies that w is not in the range of Z, which means 
that ()24|) cannot hold. Therefore we must have M = 0. 

In the general case where Z is non-singular, we argue as follows. Notice that 
Z(0) is the matrix whose (1, 1) entry is 1, and all other entries are zero. If Z > 
then there is c > such that 

Z = cZ{0) + W (50) 

where W > is singular. Since W satisfies ()22|). Lemma |H1 leads to the repre- 
sentation for W, that is 

p 

Z = cZ(0) + 5^/i,Z(x,)+MggT (51) 
1=1 

where all Xi > 0. Since W is singular, either M = and p < m — 1, or else 
p < m — 2. In the former case 2p < 2m — 2 < n so this establishes (j32p . In the 
latter case the vectors {u(xj), v(xj)}, m(0), g and Sg are linearly independent, 
and Sg is not in the range of Z. Hence by the same argument we must have 
M = 0. Again we have 2p < n. 

This completes the argument for the case when n is odd. When n is even, 
we first create a (n + 1) x (n + l) matrix Z by adding an extra row and column 
to the matrix Z. The new entries are chosen so that Z has the form (|3(J|). This 
determines uniquely all the entries of Z except the bottom right corner. This 
entry is chosen large enough so that Z > 0. To see that this is possible, note 
that the first n entries of the last column of Z are the vector SZg. From (j^Hj) 
we have the bound 

\\z-^/^szg\\ < \\Z-^/\SZg + Zh)\\ + \\Z^/^h\\ 

< F{Z){h-k,{SZg + Zh)y/' + {h,Zhy/' (52) 

Let k be the bottom right corner entry of Z. Then taking 

k> (^{h-k,{szg + zh)y/^ + {h,zhy/^y (53) 
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it follows that Z >0. Hence Lemma |H1 can be applied and we deduce that 



where Z{xi) and g are the (n + 1) dimensional versions, and again Xj > 0, and 
/ij > 0. Since 2p < n we immediately deduce (j32p by restricting both sides of 
()54|) to the top left n x n block. This completes the proof of Theorem IHl 

B Proof of Lemma [71 

We assume that the representation ()32|) holds. Lemma [7| follows from a result 
in linear algebra which we state and prove in Lemma IHl below. First we verify 
that the conditions of the lemma are satisfied. 

From (j46j) it follows that the range of Z is spanned by the vectors {u{xi), v(a;j)} 
{i = 0, . . . ,p — l). U2p < n then these vectors are independent, and hence rk{Z) 
= Y2rk{Z{xi)). If 2p = n + 1, then n is odd, and Theorem IHl implies that xq = 0. 
Since the vectors u(0) and {u(xj), v(xj)} {i = 1, . . . ,p — 1) are independent, it 
is again true that rk{Z) = ^rA;(Z(xj)). 

Furthermore, 



p 




(54) 



1=1 




n is odd 



n IS even 



(55) 



Ran{Z{xi)) 



(56) 



Since Z{xi)h is clearly in Ran{Z{xi)), we deduce that 



= Z{xi)h + SZ{xi)g G Ran{Z{xi)) 



(57) 



Lemma 9 Let Z he an n x n matrix 




(58) 



such that each Zi is symmetric and rk(Z) = ^rk{Zi). Also, let 




(59) 
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where each Vj G Ran{Zi). Then: 

(v,Z-V) = ^/i,(v,,Zriv,) (60) 

i 

Proof: It is not assumed that Z is invertible on i?"; since v G Ran{Z), Z^^v is 
always well-defined. We first prove the result in the case that each Zi = AjUjuf 
is rank 1. Since each Vj is in the range of Zj, 

Vj = ttjUj, V = ^/iittjUi (61) 

i 

The fact that rank(Z) = ^ rank(Zj) implies that the Uj's form a basis for 
Ran(Z). We write Z~^v in that basis with arbitary coefficients: 

Z-\ = ^ajUj (62) 
j 

Now apply Z to both sides: 

V = Z(^ajUj) = ^HiZiajUj = ^ Hi\i{ui,Uj)ajUi (63) 

j id i,j 

Comparing coefficients in (j61|) and (j63j) . we see that for all i, 

ai = Xi ^(uj, Uj)aj (64) 
j 

Now we can calculate: 

(v, = ^/iiai(ui,Uj)aj (65) 



5^^,(v„ZrV,) (68) 
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To get the full result is now straightforward: since each Zi is symmetric, it 
can written in terms of an orthonormal basis: 

fe=i fc=i 

Now, we can write Z as a sum of linearly independent rank 1 projections and 
apply what was shown above: 

^ = XI ^^"^'^ ^ XI ^^\ky^iM^i,k (70) 

i i.k 

V = "^HiVi = ^iJiai^k'^i^k (71) 



a? 



The final observation is that, for each i, the Uj ^ are orthogonal, which means 

= i:(T^)-.^-J. (73) 

k=l ^ '''^^ 

(--r-v.) ^ (74, 
Combining ((721) ^'^'^ (EH), we see 

(v, Z-^v) = X ) = X Zr^^t) 

i I. \ i,k / ■ 



(75) 



which was to be shown. 
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